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Abstract 



A new type of dynamical behavior of a multistable system is reported. We 
| found that a simple non-equilibrium system can reduce its effective temperature 

autonomously at a global minimum if the residual frustration at a global minimum is 
small enough, which highlights an unexpected feature of non-equilibrium multistable 



> 

, systems. 
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How can one escape from a labyrinth? The question is important not only for a 



game player but also for a researcher for multistable systems. Evolution of complex 



systems sometimes obey an optimization process of a kind of "energy" function. Since 
the landscape of the energy is in general multistable, the harm of trap at local minima 



prevents the system from reaching a global minimum. A conventional way to escape from 
^ local minima is to make thermal fluctuation in such systems, and the relaxation process 

under thermal fluctuation has been extensively studied. 

However, there is a dilemma between a barrier crossing probability in a multistable 
potential & and a stationary probability distribution of the system: High temperature 
fluctuation makes a barrier crossing between basins of multistable potential easy: But, 
unfortunately, high temperature fluctuation also makes a mean energy over a probability 
distribution increase. Simulated annealing method!', which is a strategy to lead a system 
to a global minimum by gradually decreasing the temperature of the thermal fluctua- 
tion, was introduced to avoid the dilemma and was successfully applied for several fields 
such as image restoration^, protein folding)!', neural networks® and so on. However, the 
method seems somewhat unnatural and inconvenient for physical processes because of the 
two reasons: 1) one must "control" the temperature of a system gradually, because the 
convergence to a global minimum is guaranteed when one spends infinite time to decrease 
the temperature; 2) the system never stops even if the system passes the global minimum 
state as long as the temperature is finite. This implies that the dilemma cannot be solved 
essentially even by the "simulated annealing" method. 

Although the simulated annealing method is a kind of relaxation process, one should 
remember the fact that the method is based on the equilibrium statistical mechanics 
because it uses Boltzmann distribution, which is realized for the system with detailed 
balance, in its process, Therefore, we conjectured that the dilemma might be solved 
in a non-equilibrium condition. The conjecture is partially motivated by the Levinthal's 
paradox that a protein is folded from its initial structure much quicker than the exhaustive 
sampling©. We report in this paper a preliminary example of a solution of the dilemma 
by numerical simulation of a simple model. 
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One finds that the "energy" of a multistable system is generally composed of plural 
competitive constraints or interactions each of which is relatively simple, and the competi- 
tion makes frustration in a system. The global minimum is, thereby, the state where such 
constraints are mostly satisfied: the frustration is expected to be the minimum there. An 
interesting example of this competitive dynamics can be found in on-line learning process 
of neural networks. Radons et al. reported i* that an effective temperature of parameter 
fluctuations caused by a probabilistic successive pattern input in a learning process by 
backpropagation can decrease autonomously at a global minimum under condition that 
all constraints (patterns) can be perfectly satisfied at a global minimum^. The condition 
is called as "perfectly trainable", which is approximately satisfied for the network with a 
sufficiently large number of neurons^. The autonomous decrease of fluctuation was also 
found in the learning process of chaotic time series by a conventional feedforward neural 
network© and in the learning by the neural network with coupled oscillators© . Recent 
study of on-line learning by neural networks indicates that non-thermal fluctuation due 
to the successive change of the local potential (error) is important not only for escape 
from local minima but also for an acceleration of a relaxation process even without local 
minima©, which needs a clear understanding of the effect of non-thermal fluctuations 
due to fluctuating potentials. 

The dynamics which autonomously changes the effective temperature is quite interest- 
ing from the view point of relaxation process in non-equilibrium condition. However, the 
discussions above were limited for learning by neural networks, and dynamical analysis of 
a "perfectly trainable" system has not been carried out due to their high-dimensionality 
and their complex structures. To investigate the autonomous, annealing- like dynamics 
clearly, we find a minimal model which satisfies the following conditions: 1) Each par- 
tial potential (constraint) term, V % (x), is expressed in a positive definite, different iable 
function so that a zero value state corresponds to a frustration-free state; 2) Global po- 
tential, V(x), is a linear sum of the constraints; 3) The dynamics obeys a plain relaxation 
(gradient descent) process of a dissipative particle under time-dependent potentials; 4) 
A system has small residual frustration in a global minimum state; 5) A functional form 
of the partial potential is selected to make the residual frustration of a global minimum 
small in order to demonstrate a typical self-annealing dynamics; 6) The amplitudes of the 
partial potentials fluctuate in order to make non-equilibrium fluctuation. 

A dynamics which satisfies these conditions is realized: 



where a global potential is V(x) = ^I2j=i^ l (^); a partial potential with index i is 
V l (x) = (1 — cos(ajX + 5i))/2 [for —10 < x < 10, otherwise V t (x) = oo]; the coefficients 
di and 5i are arbitrary constants; p n is an index of the partial potential at discrete time, 
n, which is chosen randomly from the partial potential indices, {1,2,3, • • -, iV}; and At 
is a constant. It should be noticed that local minima of the global potential are not 
attributed to one of the local minima of the partial potential, but are attributed to the 
result of interference of all partial potentials, which is consistent with general multistable 
systems. The mult ist ability of the partial potential is not unnatural at least for the 
learning by neural networks, because the number of available solutions is generally plural 
in the systems. The "energy" landscape discussed here is multistable and has a global 
minimum near x = when the phase shift coefficient, \Si\, is small enough. The pre-factor 
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1/N in the potential is only for a normalization purpose. 

It should be noticed that the dynamics of eq.|l| corresponds to an extreme example 
of the self-annealing dynamics that the amplitudes of partial potentials fluctuate inde- 
pendently: only one potential is alive each time step in this extreme case. However, 
the result is not essentially altered when plural partial potentials are alive, whereas the 
non-equilibrium effect is weakened in this case. It should also be noticed that the central 
result is the same for the continuous time dynamics with slowly varying amplitudes of 
partial potentials with time scale of At. The dynamics coincides with a plain relaxation 
process of a "quenched" global potential in the limit At — > 0, because the system "feels" 
an average potential. Therefore, the fmiteness of the parameter, At, is essential for the 
"non-equilibrium" dynamics. 

We find that the present system has a "self- annealing" 0) ability that fluctuation in 
phase space decreases at a global minimum autonomously if the amplitudes of constraints 
(partial potentials) fluctuate as in eq.(l). First we show the most ideal case that the 
system is in a frustration-free state at a global minimum, which is realized by setting all 
the coefficients, 5i, to be zero. Fig.l shows that the motion of the system started in a basin 
of a local minimum stops suddenly when the system reaches a global minimum state, which 
is a typical example of the " self-annealing dynamics" . It should be emphasized that the 
frustration is not reduced much at a local minimum, in contrast with the global minimum 
state. This dynamics is qualitatively different from a conventional dynamics (Langevin 
equation) subject to thermal noise (Fig. 2): 

dV(x) 

%n+l At q \x=x n sni (2) 

where £ is a probabilistic random noise with zero mean. This observation of the self- 
annealing dynamics is understandable because the perfectly global minimum condition 
(V = 0) implies that each of partial potentials is simultaneously minimized at the global 
minimum (V 1 = 0), while the local minimum condition (|p = 0) does not imply the 
stability at a local minimum for all partial potentials ( 3i : ^ 0; or < 0). 

The discussion above may seem too ideal, since the perfect minimum condition, V(x) = 
0, must be assumed at a global minimum state. Next, we discuss the case that the 
perfect minimum condition is not satisfied even in a global minimum state (Fig.3a). The 
situation is realized when some of the partial potentials, V 1 , are not minimized at the 
global minimum, due to the finite values of <5j. As shown in Fig. 3b, numerical simulation 
shows that the system never stops at a global minimum, however, the system can reduce 
its activity (fluctuation of the system) when the system reaches a global minimum and 
can be stabilized enough to stay in the global minimum. The stability of a system at the 
global minimum state in the present potential is guaranteed if the following inequality 
is satisfied: At • maxj |o»| < mhijj \ (tt — 5i)/at — 5j/aj\, which is derived from the worst 
condition that a particle cannot be transferred to a next basin of any partial potential 
by an overshooting of the largest potential gradient of partial potentials. The inequality 
roughly explains the stability at a global minimum: increase of At, \at \ and \5i \ breaks the 
stability at a global minimum. Because an increase of \5i\ from zero increases the residual 
frustration at a global minimum, the "self-annealing" dynamics works less effectively if 
residual frustration at a global minimum is not small. 

We showed in this paper that an autonomous, annealing- like dynamics (" self-annealing 
dynamics") is possible in a non-equilibrium multistable system where the residual frus- 



tration at a global minimum is small enough: The self-annealing dynamics has a unique 
property as to the convergence toward a global minimum, in contrast with simulated 
annealing: the system under self-annealing dynamics decreases its effective temperature 
by itself suddenly when the system reaches a global minimum. Non-equilibrium mul- 
tistable systems can be qualitatively different from equilibrium multistable systems of 
which fluctuation is characterized by thermal temperature. In general multistable sys- 
tems, the global minimum is the state, by definition, where each interaction is mostly 
satisfied in average; which implies that the frustration of the system is expected to be 
mostly solved in a global minimum state©. Therefore, the present simulation suggests 
that other non-equilibrium system with different forms of interactions (constraints) may 
have a possibility to show the self-annealing dynamics. 

In many body systems with exchange interactions, the global potential is convention- 
ally composed of pairs of elements with coupling coefficients, where a spin glass system 
is a prototype. Conventional solid state material is usually assumed that the exchange 
interaction is fixed as known in "quenched" systems. In such quenched systems, the 
self-annealing dynamics does not appear. However, we conjecture that some many body 
systems such as biological systems which are far from equilibrium condition might show 
the self-annealing dynamics, since the exchange interaction may fluctuate in such systems. 
We also expect that the self-annealing dynamics might be useful for optimization prob- 
lems where the energy (or error) function of the problem is made by the composition of 
plural constraints: successive evolution of the system under the presentation of a partial 
constraint can produce the self-annealing dynamics. The studies of such realizations are 
under way. 
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Figure 1: Temporal evolution of the self-annealing dynamics in the most ideal case, a) 
Landscape of a total potential energy, V(x), where the number, N, of partial potentials 
is 10. The coefficients, a t , are chosen as: { 1, 1.38, 2.75, 1.96, 1.27, 1.64, 1.42, 2.29, 
2.47, 2.72} for demonstration. The coefficients, 5i, are chosen as zero in order to stabilize 
the global minimum state perfectly, b) Typical trajectories of a phase space and a total 
energy. 



Figure 2: Temporal evolution of the conventional Langevin equation subject to random 
noise (eq.(2)), where £ n is a uniform random number, r n , \r n \ < 0.5. Typical trajectories 
of a phase space and a total energy are shown. The potentials used are the same as in 
Fig.l. 



Figure 3: Temporal evolution of the self-annealing dynamics in the less ideal case, a) 
Landscape of a total potential energy. The number, N, of partial potentials and the 
coefficients, a^, are chosen as in Fig.l. The coefficients, Si, are chosen as: {-0.7, 0.2, -0.2, 
0.1, -0.6, 0.3, -0.5, 0.1, -0.3, 0.2} respectively corresponding to {<2j} in Fig.l. b) Typical 
trajectories of a phase space and a total energy. 



